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Abstract 

There are three levels of description in classical statistical mechan- 
ics, the microscopic/dynamic, the macroscopic/statistical and the ther- 
modynamic. At one end there is a well-used concept of equilibrium 
in thermodynamics and at the other dynamic equilibrium does not ex- 
ist in measure-preserving reversible dynamic systems. Statistical me- 
chanics attempts to situate equilibrium at the macroscopic level in the 
Boltzmann approach and at the statistical level in the Gibbs approach. 
The aim of this work is to propose a reconciliation between these ap- 
proaches and to do so we need to reconsider the concept of equilibrium. 
Our proposal is that the binary property of the system being or not be- 
ing in equilibrium is replaced by a continuous property of commonness. 

Keywords: Boltzmann; Gibbs; approach to equilibrium; ergodic decom- 
position. 



1 Introduction 

One of the fundamental problems in the foundations of statistical mechanics is 
to give an explanation as to why 'equilibrium' statistical mechanics is so success- 
ful. That is to say, why the use of the standard Gibbsian methods 'reproduces' 
thermodynamic results. One offered explanation for this is the standard ergodic 
approach. As to whether this gives an acceptable explanation Van Lith (2001) 
offers the impression "that the communis opinio in the physics literature is that 
it does; in the philosophy literature that it doesn't". My impression agrees with 
hers. However, there is a further twist to the story. When confronted with 
the question of what is 'actually going on' in a gas of particles (say) when it is 
in equilibrium, or when it is coming to equilibrium, many physicists are quite 

*This is a modified version of the conference contribution presented un- 
der the title of "Is Equilibrium a Useful Concept in Statistical Mechanics?". 
To appear in Stud. Hist. Phil. Mod. Phys. Juno 2005. 
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prepared to desert the Gibbsian approach entirely and to embrace a Boltzman- 
nian view (Ruelle, 1991; Lebowitz, 1993; Bricmont, 1995; Goldstein, 2001). In 
particular according to Goldstein (ibid): 

"Ludwig Boltzmann explained how irreversible macroscopic laws . . . 

originate in the time-reversible laws of macroscopic physics. Boltz- 
mann's analysis ... is basically correct. The most famous criticisms 
of Boltzmann's later work on the subject have little merit. Most 
twentieth century innovations such as the identification of the state 
of a physical system with a probability distribution p on phase space, 
of its thermodynamic entropy with the Gibbs entropy of p, and the 
invocation of the notions of ergodicity and mixing for the justifica- 
tion of statistical mechanics - are thoroughly misguided" (p. 39). 

and Lebowitz (ibid): 

"Having results for typical microstates rather than averages is not 
just a mathematical nicety but at the heart of understanding the 
microscopic origin of observed macroscopic behaviour. We neither 
have nor do we need ensembles .... What we do need and can expect 
is typical behaviour" (p. 38). 

These assertions are reinforced by the opinion of Ruelle^ (ibid) that the Bolz- 
mannian approach 

"is now generally accepted by physicists. . . . There are some dis- 
senting voices, such as that of Ilya Prigogine, but the disagreement 
is based on philosophical prejudice rather than physical evidence" 
(p. 113). 

However, most work in equilibrium statistical mechanics uses the tools developed 
by Gibbs. Given a particular thermodynamic setup and microscopic model the 
appropriate probability distribution (microcanonical, canonical, grand-canonical 
etc.) is chosen. The entropy is taken to be that of Gibbs and the holy grail 
for any investigation is an analytic form for the partition function; the notable 
successes being the solution of the zero- field two-dimensional Ising model by On- 
sager (1944), of the six-vertex model in 1967 by Lieb (see, Lieb and Wu, 1972) 
and of the eight-vertex model in 1972 by Baxter (sec, Baxter, 1982). There 
have been many attempts to extend the Gibbs approach to non-equilibrium. 
As indicated above in the quote from Ruelle, the most developed programme 
for doing this is that of the Brussels Austin School of the late Count Ilya Pri- 
gogine.^ However, many remain unconvinced of either the actual or potential 
success of this enterprize. There would seem to be the need to explore the 

think RucUc rather overstates the case. In particular the rational subjectivist approach 
of Jaynes (1983) and the interventionist approach most recently argued for by Ridderbos and 
Redhead (1998) and Ridderbos (2002) would find some favour. 

^Although the fundamentals of the work of this school have remained unchanged since 
their inception in the early sixties, the approach has evolved substantially, leading to a great 
wealth of publications. For a comprehensive review see Bishop (2004). 
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possibility of holding, with Lcbowitz, Goldstein, RucUc ct al., to the conviction 
that Boltzmann got it right about the approach to equilibrium, whilst at the 
same time with a good conscience continuing to use the standard distributions 
of Gibbs for everyday equilibrium calculations. We shall attempt to take some 
steps along this path. In order to do so we need to resolve in some way three 
questions, to which the current versions of the Gibbs and Boltzmann approaches 
offer apparently irreconcilable answers. 

(i) What is meant by equilibrium? 

(ii) What is statistical mechanical entropy? 

(iii) What is the object of study? 

The attempt to produce conciliatory answers to (i) and (ii) will occupy most 
of this paper. However, we must at the outset deal with (iii). Ensembles are 
an intrinsic feature of the approach of Prigogine for whom "it is at the level 
of ensembles that temporal evolution can be predicted" (Prigogine, 1994, p. 
8) and for Mackey (1989) a "thermodynamic system is [my italics] a system 
that has, at any given time, states distributed throughout phase space . . ., and 
the distribution of these states is characterized by a density . . ."(p. 984). The 
density referred to is the ensemble density and thus the ensemble becomes the 
way that a thermodynamic system is defined. In contrast to this we shall follow 
the view of Lebowitz given above that the object of study in statistical mechanics 
is a single system. All talk of 'ensembles' is taken to be just a way of giving a 
relative frequency flavour to the probabilities of events occurring in that system. 

In Sec. 2 we define the dynamic microstructure of our system and introduce 
two gas models which will be used as examples in the later parts of the paper. 
In Sec. 3 we describe the different concepts of equilibrium in dynamics, the 
Boltzmann and Gibbs approaches to statistical mechanics and thermodynamics 
In Sec. 4 we discuss the Boltzmann approach with particular reference to the 
way in which equilibrium is defined and the Neo-Boltzmannian reliance on the 
concept of typical behaviour. With respect to the latter we suggest that the ex- 
pected typical behaviour can be encapsulated by the term 'thermodynamic-like', 
which signifies the type of fluctuations to be expected in dependent thermody- 
namic variables, most particularly the entropy, and we discuss the conditions 
on the system needed for thermodynamic-like behaviour to be typical. At that 
point it is necessary to consider the usual demarcation made between the system 
being or not being in equilibrium and we discuss, with the use of the example 
of the baker's gas with a small number of microsystems, the problematic nature 
of this property. This leads us to the rather radical suggestion that it would be 
better to replace the binary equilibrium property with a continuously changing 
property which we call commonness. In Sec. 5 we use the example of a gas 
expanding in a box when a partition is removed to describe the role ascribed 
to the Gibbs approach in the overall picture we are attempting to develop. Of 
course, one question which needs to be addressed is the meaning of probability 
and this is discussed in Sec. 6. Sec. 7 contains our proposals for a model in- 
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corporating both the Boltzmann and Gibbs viewpoints and our conclusions are 
presented in Sec. 8. 

2 The Microstructure 

Consider a system that, at time t, has a microstate given by the vector x{t) in 
the phase space F. The time parameter t can be discrete or continuous and the 
phase space can also be continuous or discrete. Some onc-to-onc autonomous 
dynamics x — > 0t a;, {t > 0) determines a flow in F and the set of points 
x{t) = (ptx{0), parameterized by t > 0, gives a trajectory. The set of mappings 
{0t}«>o is a semi-group. The system is reversible if there exists an idempotent 
operator 3 on the points of F, such that (j)tX = x' implies that (j)t'3x' = 3x. 
Then (f)_t = {4't)~^ = '^'Pt'^ and the set {(/>(} with t e M or Z is a group. 
Henceforth we shall assume that the system under discussion is reversible. If F 
consists of a finite number of points then t G Z and the system is periodic. If F 
is continuous then f e Z or f e M. In this case, we shall restrict attention to a 
subset A C F invariant under Wc denote by m a measure on A such that 

(a) m(A) is finite, (b) m is absolutely continuous with respect to the Lebesque 
measure on A, (c) m is preserved by the flow; that is m(^t7) = m(7), for all 
t and all measurable 7 C A. It can now be shown that the Poincarc (1890) 
recurrence theorem will apply (Ott, 1993, p. 214) to flows for which a;(0) G A. 

2.1 Useful Examples 

To clarify the discussion it useful to resort to computer simulations of simple 
models. However, most interesting problems in statistical mechanics concern 
cooperative systems and, even at equilibrium (see e.g. Baxter, 1982), there are 
few of these which can be solved exactly. So, of necessity, useful examples 
are of assemblies of non-interacting microsystems and the literature contains 
discussions of many 'toy models' of this kind.'^ Here we shall use two. 

2.1.1 A Perfect Gas — Continuous Time and Continuous Space 

Consider a gas of N particles of unit mass moving in the two-dimensional box 
—L/2 < X < L/2, —L/2 <y< L/2, with elastic walls. We suppose that the ini- 
tial positions {x^''^ (0), y^^^ (0)), fc = 1, 2, . . . , A'' of the particles are such that all 
thcyW(O) are distinct and the initial velocities are all in the x-direction. Then 
all the particles will perform one-dimensional oscillations in the x-direction 
at constant speeds. If we denote the positions and velocities at time t by 
{x^''\t) , v^''\t)) , k = 1,2, ...,A^ then \v^^\t)\ is constant and the system is 
reversible with J(a;('°\ v^'^)) = (a;^'^) , — i'*^'^'). In Fig. 1 we show a typical evo- 
lution of the gas from a state where all the particles are congregated near the 
left-hand end of the box. Calculations for this example are used to illustrate 

3 A model which has featured prominently in such discussions is the spin-echo system. For a 
recent a<;count of this model see Lavis (2004) and for simulations for a number of deterministic 
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Figure 1: A perfect gas oi N = 1000 particles moving horizontally in a box with 
elastic walls. 

the discussion in Sec. 7. 

2.1.2 A Baker's Gas - Discrete Time and Continuous Space 

This is the transformation, shown in Fig. 2. where a square of side L is stretched 
to twice its width and then cut in half with the right-hand half used to restore 

and stochastic systems see Lavis (2003). 
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Figure 2: The baker's transformation and its inverse. 



the upper half of the unit square. As the mapping (j) on the cartesian coordinates 
L X [x, y) of the square, it is given by 



A convenient way of writing this transformation is to express x and y as binary 
strings: x = Q ■ xiX2X^ . . . and y = ■ yiy2yz ■ ■ ■ with Xk, yk = 0, 1. Then the 
transformation takes the form 0(0 • XxX^Xz . . . , • yiy^y^ . . .) = (0 • X2X^X4, . . . , • 
xiy\y2 ■■■), with (f)-^{Q-x\X2X2, . . .,0-yiy2y3 ■■■) = (0- 2/1x1x2 . . . ,0-y2?/3y4 • • •)• 
The mapping is reversible with (f)~^ = '3(j)3 and 3(x,y) = {y,x). It can also be 
shown (Lasota and Mackey, 1994, p. 54-56) to be volume-preserving and thus 
that the Poincare (1890) recurrence theorem applies. We are interested in a 
baker's gas of N 'particles'. In Fig. 3 wc show a typical evolution from a state 
where all the particles are congregated near the bottom left corner of the box. 

3 Different Views of Equilibrium 

The three levels of description in classical statistical mechanics, referred to in 
the abstract, each bring with them a definition of equilibrium. In fact by sepa- 
rating the macroscopic (Boltzmann) and statistical (Gibbs) approaches one can 
identify four distinct concepts of equilibrium. 

A dynamic system is in equilibrium at time t if its state is given by a phase 
point x{t) lying on an attractor.* However, of course, measure-preserving re- 

*For our purpose this is an adequate definition, altliougli thie term is sometimes used only 
for fixed points, where its use includes repelling (unstable) and marginal equilibrium points. 
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Figure 3: A gas of N = 512 particles moving under the baker's transformation. 



versible dynamic systems do not have attractors.^ 

To describe the Boltzmann approach wc need to introduce some macroscopic 
variables. In general, these will be at the observational level for the system, but 
will encapsulate more detail than the thermodynamic variables.^ Examples 

^This means that the remark by Sklar (1993, p. 156) that in statistical mechanics "the 
equilibrium state exists as the 'attractor ' to which the dynamics of non-equilibrium drives 
systems . . ." must not be taken too literally. 

^Ridderbos (2002) refers to them as supra-thermodynamic variables. 



7 



of these would be local variables which quantified spatial inhomogeneities of 
density or magnetization in a system (see Sec. 4).'' Suppose that, as in our 
examples discussed below, the system consists of N identical microsystems and 
that we have a set S of macrovariablcs. A macrostatc //, is a m-measurable 
subset of A. The set of macrostates {fi} is defined so that: 

(i) Every a; € A is in exactly one macrostate denoted by fix- 

(ii) Each macrostate corresponds to a unique set of values for S. 

(iii) Hx is invariant under all permutations of the microsystems. 

(iv) The phase points x and dx are in macrostates of the same size.^ 

Given a particular set of macrovariables and macrostates, the Boltzmann En- 
tropy is given by 



Equilibrium is defined by reference to the macrostate, which is uniquely given by 
a set of values of the macrovariables. According to Bricmont (1995, p. 179), "by 
far the largest volumes correspond to the equilibrium values of the macroscopic 
variables (and this is how 'eqiulibrium' should be defined)". This is the standard 
Boltzmannian definition. The system is in equilibrium if its phase point is in the 
macrostate of largest volume (m-measure), corresponding to the largest value 
of Sb, and this in turn defines the equilibrium values of the macrovariables. 

The starting point for the Gibbs approach is to suppose the phase-point 
X, in some invariant A C F, is distributed according to a probability density 
function^ p which is invariant under the flow (a solution of Liouville's equation). 
Equilibrium is defined as the situation where the probability density function is 
not an explicit function of time and p becomes a function of the global constants 
of motion. The statistical mechanical 'analogues'^° of thermodynamic quantities 
are either fixed external parameters, related to phase functions^^ or functional 
of p. In particular the analogue of thermodynamic entropy is the Gibbs entropy 



^Another simple example, in the context of coin-flipping, is given by Bricmont (2001, p. 8). 
In N tosses of a coin a microstate is a particular record of the N outcomes and a macrostate is 
identified by the macrovariable Nq and consists of the set of all microstates for which exactly 
iVo of the outcomes are heads. 

^This is necessary to ensure that the macrostate structure reflects the reversibility of the 
system; which means that the Boltzmaim entropy profile along x —* (j>tx is the same as that 
along 3a! — » 3<t>tx = (t>-t3x. In fact, of course, in cases, like the perfect gas where macrostates 
are created by course-graining the one-microsystem conflguration space and reversibility cor- 
responds to changing the sign of the velocity x and 3x are in the same macrostate. 

''So that the probability of the phase point being in a small region 6A around a phase point 
X is p(cc)ra(6A). The meaning wc give to probability is discussed in more detail in Sec. 6. 
^"This is the term used by Gibbs (1902, chap. 14). 
^^In a way which will be discussed in Sec. 7. 



Sb{x) = fcBln[m(/Xa!)]- 



(2) 




(3) 
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From a practical point of view this scheme is very satisfactory. However, prob- 
lems arise when an attempt is made to extend it to non-equilibrium situations, 
which are now perceived as being represented by time-dependent solutions of 
Liouville's equation. Specifically: 

(i) When p{x) is replaced in (3) by any time-dependent solution p{x; t) of 
Liouville's equation, 6*0 remains invariant with respect to time. 

(ii) Given an arbitrary initial condition p{x;Q), the evolving solution p{x;t) 
of Liouville's equation will not in general converge to a time-independent 
(equilibrium) solution as t ^ 00. 

The Brussels-Austin programme is, as we have indicated above, an attempt to 
circumvent these problems. 

In classical thermodynamics the approach to equilibrium is usually described 
as leaving the system so that it "eventually reaches a state in which no further 
change is perceptible, no matter how long one waits" (Pippard, 1961, p. 6). 
The equilibrium state is thus the situation in which (for an isolated system) 
no perceptible change occurs in any thermodynamic variables. However, Uffink 
(2001) has argued that the tendency of isolated systems to approach equilibrium 
is not a consequence of the standard laws of thermodynamics. This has led 
Brown and Uffink (2001, p. 528) to formulate a principle which they call the 
minus first law that "an isolated system in an arbitrary initial state within a 
finite fixed volume will spontaneously attain a unique state of equilibrium". 
With this addition, thermodynamic equilibrium, for a finite isolated system, 
can be seen to have three important properties: 

(a) It is a binary property; a system either is or is not in equilibrium. 

(b) A system in equilibrium never evolves away from equilibrium. 

(c) A system not in equilibrium evolves into equilibrium. 

Indeed the quote from Pippard may seem to allow us to add 'in a finite time' 
to (c) or at the very least that 'so that the difference from equilibrium after a 
finite time is imperceptible'. 

In this description of four distinct types of equilibrium, dynamic equilibrium 
has been included for completeness. Although it shares properties (a) - (c) with 
thermodynamic equilibrium it exists only for dissipative systems. Statistical 
mechanical equilibrium for the systems considered here, for which the dynamics 
is non-dissipative, cannot be a consequence of, or related to, the system being in 
dynamic equilibrium. The Brussels-Austin extension of the Gibbs programme 
would also satisfy properties (a)-(c). However, as will be discussed in Sec. 4, the 
form of equilibrium which features in the Boltzmann approach does not satisfy 
(b) and satisfies (c) only in a qualified sense (see Sec. 4). 

A classic problem in statistical mechanics (Sklar, 1993, chap. 9;Callender, 
1999) is to understand in what sense thermodynamics can be said to reduce to 
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statistical mechanics and thus part of the problem of equilibrium is to relate 
in some way equilibrium in statistical mechanics and equilibrium in thermo- 
dynamics. However, as we have seen there is no unique statistical mechanical 
equilibrium. The Boltzmann and Gibbs approaches have very different concepts. 
Indeed, with the usual ensemble interpretation of the probability density func- 
tion, Gibbsian equilibrium is, unlike Boltzmannian equilibrium, not a property 
of an individual system. So for us the problem is both to effect a reconciliation 
between Boltzmannian and Gibbsian equilibrium and to relate them to ther- 
modynamic equilibrium. To do this we propose that equilibrium as a binary 
property is replaced by something (which we call commonness) which encapsu- 
lates degrees of 'equilibriumness'. 



4 The Boltzmann Approach 

Most examples of the use of this approach consider situations where the macrovari- 
ables measure inhomogeneities in the distribution of microsystems over the 
one-microsystem phase space. This space is divided into p cells, labelled £ = 
1,2, . . .,p, and, for the phase point x G A, N^{x) is the number of microsystems 
in cell £ = l,2,...,p. Given that the microsystems are identical, the macrostate 
/Xa; G A corresponds to all permutations of microsystems in cells with the same 
values of the macrovariables. Thus 

m(A) Y{UWx)V.p-- ^' 

For the baker's gas A is the union of N squares of side L giving ra(A) = 
and we divide the one-particle phase space (configuration space in this case) 
into squares of side L/2'" to give p = 2^™.^^ In the case of the perfect gas 
ra(A) = and we take p = 2™. 

As indicated above, the entropy in the Boltzmann approach is the phase 
function (2), which will fluctuate with time, the system being construed as being 
in equilibrium when entropy has its maximum value (5'B)Max- The difficulties 
associated with this definition of equilibrium are discussed in Sec. 4.1. However, 
another question arise in relation to this approach. This is usually identified as 
the problem of the 'approach to equilibrium'.^^ However, it can be extended 
to the broader problem associated with certain expectations about the form of 
the entropy profile and the need to give a dynamic account which justifies these 
expectations. In somewhat imprecise language, we expect that in most cases 
the entropy will behave in a thermodynamic-like way. This we take to mean 
that: 

^•^Thc cells arc labelled sequentially in rows, so that cell (1, 1) in the bottom left corner is 
labelled £ = 1 and cell (2™, 2'") in the top right corner is labelled £ = p. 

-'^■'And part of the discussion is concerned with giving some explanation as to why the 
universe seems to have started in a very uncommon state. According to Goldstein (2001) 
this is the "hard part" of the Boltzmann approach. It is beyond the scope of the present 
discussion. 
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The Boltzmann entropy, for the evolving system, is most of the time 
close to its maximum value, from which it exhibits frequent small 
fluctuations and rare large (downward) fluctuations. 

The problem of quantifying and justifying these expectations is discussed in Sec. 
4.2. 



4.1 Trying to Define Equilibrium 



It is clear that (S'B)Max will not necessarily be the value of entropy for the 
largest proportion of microstates. Associated with a macrostate /x, there will be 
a degeneracy giving the number of macrostates of measure m(/x).^^ We 

define 

"^^^^^^^^ where m(A) = ^m(M) 



T(/x) 



m(A) 



m(A) 



(5) 



and (S'b)t denotes the Boltzmann entropy for a macrostate giving the largest 
value of T{p,). With 

5a = 5b(A) =fcBln[m(A)], (6) 



the entropy of A, it is clear that the inequalities > (<S'B)^ 
satisfied^^ and, from (4), 



> ('S'b)t must be 



•S'a — {Sb 



NkB 
where 



< 



BIT 



< 



N ^ 



Ta(j») 
Ar^m(A) 



In 



m(A) 



< 



ln[??(iV,p)] 



(7V+P- 1)! 



(7) 



(8) 



m(j)-\)\ 

In Fig. 4 we show the Boltzmann entropy of the baker's gas for various cases 
of different numbers of particles and cells, where initially the gas starts with all 
the particles in cell (1,1).^^ We observe a rapid rise of the scaled entropy from 
its initial value of zero followed by small fluctuations around a value rather less 
than the scaled value of unity.^^ It is clear that, in all the cases shown in Fig. 4, 
T(/i) is not maximal for the largest macrostate, although detailed computations 
with large values of N are not only difficult, but not particularly revealing. 

It is more useful to concentrate on small values of A'' and p where the results 
arc easy to compute. With p = 4 cells (m = 1) and A'' = 8 we denote by the 
vector n = (ni, 712, ria, 714) an unordered distribution of particles in the four 
cells, with fl{n) being the number of macrostates with this distribution. Data 
for this case are given in order of decreasing T(n) in Table 1. It will be observed 

^*In the case of our examples r2(^) will equal the number of distinct permutations of 
{Ni,...,Np}. 

^^Assuming that the Boltzmann entropy is additively scaled so as to be non-negative. 

^®In all graphs of the Boltzmann entropy and Table 1, the minimum entropy is set to zero 
with the condition p = V . Additionally in Fig. 4 the entropy is scaled by its maximum value. 

^''This behaviour is, of course, typical of a wide range of models with both discrete and 
continuous phase spaces (Lavis, 2003). 
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N=2m, m=4 




10 20 30 40 



20 30 40 





Figure 4: The scaled Boltzmann entropy as it evolves with time for the baker's 
gas model. Initially all the particle are randomly distributed in cell (1,1), (iVi = 
A^). The figures in horizonal lines correspond (from top to bottom) to average 
numbers of particles per cell of 8, 2 and 0.5 respectively. 



that the macrostate of maximum size n = (2,2,2,2) is the eighth in the list. 
Values derived from Table 1 are 5a = Nk^ 1.3863, (5B)Max = Nk^ 0.9790 and 
(5b)t = 0.9283. A typical evolution of the entropy for this case is shown 
in Fig. 5. The 'plateau' at (5'b)t will be observed. 

So if we were to propose a definition of the equilibrium macrostate what 
would we choose? If wc take a quasi-thcrmodynamic view and suppose that the 
equilibrium value for the entropy is that into which it settles, with subsequent 
small fluctuations (and very rare large fluctuations) then for small systems we 
have shown by simulation that this is not the largest entropy, for which the 
system would be in the largest macrostate. An obvious strategy would be to 
broaden the range of entropy for equilibrium. One might, for example, say 
that the system is in equilibrium if Sb G [(S'B)Max, ('5'B)Max(l — e)], where e = 
2[(5B)Max — (<S'B)r]/(<S'B)Max- A slmllar kind of 'e-equilibrium' strategy, in the 
context of the Gibbs approach, was proposed by Van Lith (1999). In our case, 
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n 


n{n) 


Ta(n)/m(A) 


S^{n)/{Nk^) 


T(n) 


(3,2,2,1) 


12 


0.0256 


0.9283 


0.3076 


(4,2,1,1) 


12 


0.0128 


0.8417 


0.1538 


(3,3,1,1) 


6 


0.01709 


0.8776 


0.1025 


(3,3,2,0) 


12 


0.0085 


0.7910 


0.1025 


(4,3,1,0) 


24 


0.0043 


0.7043 


0.1025 


(4,2,2,0) 


12 


0.0064 


0.7550 


0.0769 


(5,2,1,0) 


24 


0.0026 


0.7271 


0.0615 


(2,2,2,2) 


1 


0.0385 


0.9790 


0.0385 


(5,1,1,1) 


4 


0.0051 


0.7271 


0.0205 


(5,3,0,0) 


12 


0.0009 


0.5032 


0.0103 


(6,1.1,0) 


12 


0.0009 


0.5032 


0.0103 


(4.4.0.0) 


6 


0.0011 


0.5311 


().()()()4 


(6,2,0,0) 


12 


0.0004 


0.4165 


0.0052 


(7,1,0,0) 


12 


0.0001 


0.2599 


0.0014 


(8,0,0,0) 


4 


0.15 X 10"* 





0.61 X 10"* 



Table 1: Data for the baker's gas with N = S and p = 4. 




0.4 



0.2 - 

20 40 60 80 100 120 140 160 180 200 

t 

Figure 5: The scaled Boltzmann entropy for the baker's gas model with N = 8 
particles and p = 4. Initially all the particle are randomly distributed in cell 
(1,1), with configuration (8,0,0,0) and degeneracy of four. Horizontal lines at 
('S'B)Max and (S'b)t are shown. 

of course, this means that there will be small fluctuations of entropy within 
equilibrium and the possibility of evolution out of equilibrium accompanied by 
a large downward fluctuation in entropy. In addition to the arbitrary division 
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into macrostatcs, wc have added a demarcation given by the choice of vahie for 
£. This is a simple demonstration of our contention that the quahty which we 
are trying to capture is a matter of degree, rather than the two-valued property 
of cither being in equilibrium or not in equilibrium. We, therefore, make the 
following proposal: 

All references to a system being, or not being, in equilibrium should 
be replaced by references to the commonness of the state of the sys- 
tem, with this property being given by some suitably-scaled mono- 
tonically increasing function of the Boltzmann entropy. 

Of course, at this stage, the proposal is confined to the Boltzmann approach. 
However, we hope to show that its implementation is of relevance to the develop- 
ment of a view of statistical mechanics which incorporated both the Boltzmann 
and Gibbs approaches and their connection to thermodynamics. It should be 
emphasized that no connection is implied, at this stage, between commonness 
and 'commonness of occurrence'. Wc arc not assuming that a microstate with 
large commonness (a common microstate) belongs to a macrostate which is vis- 
ited more often by an evolving system. This connection is related to the question 
of typical behaviour. 

4.2 Thermodynamic-Like Behaviour 

A favoured term of the Neo-Boltzmannians (but not of Boltzmann himself) is 
'typical'. Thus, in the quote from Lebowitz (1993) in Sec. 1, he refers to 'typical 
microstates' and 'typical behaviour' and, in a later paper (Lebowitz, 1999), he 
makes the assertion that 

"^B will typically increase in a way which explains and describes 
qualitatively the evolution towards equilibrium of macroscopic sys- 
tems. Typical, as used here, means that the set of microstates cor- 
responding to a given macrostate [/u] for which the evolution leads 
to a macroscopic decrease in the Boltzmann entropy during some 
fixed time pc;riod r, occupies a subset of [//] whose [measure] is a 
fraction of [ra(/x)] which goes very rapidly (exponentially) to zero as 
the number of [particles] in the system increases" (p. S348).^^ 

Now in ordinary usage 'typical' is a description applied to an element of a 
set with respect to some particular property. In most instances of the use of 
'typical' by the Neo-Boltzmannians the element of interest is a microstate (phase 
point) picked from phase space (or an energy surface in phase space). The 
property is 'imminent evolution towards equilibrium indicated by an increase in 
Boltzmann entropy' or perhaps more precisely 'the absence of a imminent large 
decrease in Boltzmann entropy'. 

^*We have used square brackets to replace Lebowitz's notation by our own. 

^^Thus a 6 .4 is typical of A with respect to the property 6 if a and most members of A 
have the property b. Or alternatively b is typical of the set ^ if a randomly chosen member 
of A is very likely to have the property b. 
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Lcbowitz tics this behaviour to the structure of macrostates. This connection 
could be amphfied in the following way. For the macrostate ji let consist of 

all X G n such the the immediately next and immediately previous macrostates 
along the trajectory are of measure larger than /i.^" With ^ and fA^^^ 
defined in a similar way, it follows, from the reversibility of the system and 
property (iv) of the macrostates listed in Sec. 3, that m(/U^ '"^) = m(/U^+~^). 
The Neo-Boltzmannian argument is now based on the supposition that 

m(/x(++)) » m(/x(±T)) » m(/x(~)), (9) 

for all (or most) macrostates n, with the inequality becoming increasingly pro- 
nounced as N increases. Thus, for an arbitrarily chosen macrostate, the measure 
m{iJ,^~^~^^ U /i^ ^•') of phase points which lead to an increase in entropy is very 
much larger than the measure m(/U*^^ U /x'^^^) of phase points which lead to 
a decrease in entropy. Then a typical (randomly chosen) point in fj, belongs to 
u yi( 1")^ leading to an increase in entropy. This is justified by Bricmont 
(2001) using Bayesian arguments. No explanation is needed for the typical in- 
crease in entropy, beyond the application of the law of large numbers in the limit 
of large N. If typical behaviour differs from this then an explanation must be 
sought (maybe a re-examination of the designation of macrostates) . Within its 
own terms this Bayesian gloss of typicality is perfectly satisfactory. However, it 
is predicated on the validity of (9). While this appears to be true for many toy 
models^^ general rules for its validity are more difficult to formidate. 

But most statistical mechanical explanations are concerned with something 
more than just the immediate increase in entropy following the arbitrary se- 
lection of an initial phase point. The object of interest is the evolution along 
a trajectory and the Bayesian argument does not adequately account for this. 
Consider the following scenario. For a system a phase point x is chosen. It hap- 
pens to be in the macrostate and according to good Bayesian (or Laplacian) 
arguments and the inequality (9) it will typically lie in U fx'^ ^\ Now 

suppose, in the course of evolution, the contiguous transition a; — > x' occurs 
to a macrostate fj,'. By definition m(/x') > m(^) and x' G ij,'^ '"^ U fj,'^ \ 
Now if x' were chosen randomly in /i''' U /i'*" wc might typically expect, 
from (9), that x' G /u'' ^\ leading to a further increase in entropy. However, 
this is not necessarily the case. The dynamics determines the location of x' in 
^/(-+) ) Mcj-eiy to associate probabilities with measure without random 

selection is not adequate to close the argument. 

The requirement of statistical mechanics is that a typical trajectory is 
thermodynamic-like, according to the definition of this term on page 11. As 
yet this definition lacks precision. However, it is certainly the case that if, along 
a trajectory and for most macrostates /x, the phase point spent an amount of 
time in n proportionally related to Ta(/u) the requirement of thermodynamic- 
like behaviour would be satisfied. To be more precise, for any a; £ A, let Cx 

^"For easy of discussion we ignore the possibility of contiguous macrostates of equal measure. 
^^It is easy to verify for particular cases of the Kac ring model, which is the example most 
often cited by Bricmont. 
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be the trajectory through x, and T^ip-) be the proportion of the time that the 
phase point on this trajectory is in /z.^^ Now we can define thermodynamic-like 
behaviour along the trajectory as the situation where Ta.(/i) is approximately 
proportional to ra(/i). The more common a macrostatc is the more common will 
be its occurrence along a trajectory. For this behaviour to be typical it must be 
true for most trajectories. This will hold in strong sense if 

T(/x) = t(/x), where T(/i) = ra(/i)/ra(A) (10) 

for all /i and all trajectories apart from a set of measure zero. This is, of course, 
the condition that the system is ergodic. So ergodicity is sufficient for (perfect) 
thermodynamic-like behaviour along all but an atypical set of trajectories of 
measure zero. 

The baker's transformation is a Kolmogorov system (Lasota and Mackey, 
1994, p. 91) and is, therefore, both ergodic and mixing. ^"^ So we have an expla- 
nation for the typical thermodynamic-like behaviour exhibited in Figs. 4 and 
5. It is also not difficult to describe at least some of the measure-zero atypical 
trajectories. Suppose that the initial binary strings giving the particle positions 
were periodic and the periods of all the particles were commensurate. Then the 
behaviour of the system (detected, for example, by its entropy profile) would 
have a periodic form at variance with thermodynamic-like behaviour. The per- 
fect gas of Sec. 2.1.1 is also ergodic (but not mixing) as long as the particle 
speeds are incommensurate (Farquhar, 1964, p. 96-98)^^ and the atypical tra- 
jectories correspond to a choice of initial speeds which are commensurate and 
produce periodic, rather than quasi-periodic behaviour. 

However, ergodicity is not necessary^^ since (10) is stronger than is required 
for a typical system to behave in a thermodynamic-like way and atypicality 
can also be broadened to include a set of trajectories of small but non-zero 
measure. As pointed out by Bricmont(1995, 2001) and verified by numerical 
calculations (Lavis, 2003) the Kac ring model, which is not ergodic, exhibits 
clear thermodynamic-like behaviour. 

The typicality of thermodynamic-like behaviour, away from the perfect case 
of an ergodic system, is difficult to formulate. What counts as sufficiently 
close to the perfect situation of (10) to yield an entropy profile which looks 
thermodynamic-like and how much atypical behaviour can be tolerated? For 

^^It was shown by Birklioff (1931) that Tx{p.) exists and is independent of the location of 
X on Cx for almost all a; G A; that is except possibly for a set of ra-measure zero. From this 
it follows (see e.g. Lavis, 1977) that Ta;(/i) is a constant of motion almost everywhere in A. 

^■'in fact it is a Bernoulli system (Arnold and Avez, 1968, p. 125-126). 

^''Thc proof of this given by Farquhar, which is a version of the discussion by Khinchin 
(1949, p. 58-62), is for two independent particles with periodic boundary conditions and 
ergodicity is over the reduced manifold defined by the normal integrals of the motion. Our 
model maps into one with periodic boundary conditions and particle velocities to the right 
by 'unfolding' the interval [— L/2,L/2] into [— L.L] (Lavis, 2004). Then it can be seen that 
the only independent normal integrals of the motion arc i'*' = v^^^i , k = 1,2, . . . , N and the 
motion is ergodic over the hypercube a:^*) € [-L, L], k = 1,2, . . . , N . 

■^^Bricmont (1995) also argues that ergodicity is not sufficient, but this is based on the use 
of ergodicity to justify measurements as infinite time-averages. 

^®Its phase space divides into cycles. 
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the purpose of this work we shaU leave these questions open with symbols of 
approximation standing as markers for a more detailed investigation.^^ 

Ergodicity on A is, of course, equivalent to A being metrically indecompos- 
able under the flow, and a non-ergodic situation where we can at least map out 
the elements of the discussion is when there is a finite or denumerable ergodic 
decomposition of A. That is, to within subsets of zero measure, 

A=U^- (11) 

where each component A„ is invariant and metrically indecomposable under 
the flow. Ergodic decomposition will, of course, apply to any model (like, for 
example, the Kac ring) where A consists of a finite number of discrete points; 
then each A^ is a cycle of states. Ergodic decomposition also applies where the 
system is e-ergodic (Vranas, 1998). In this case one element of the decomposition 
Ai (say) is such that m(Ai) = (1 — £)m(A) for small e > 0.^^ 

When (11) applies, the time spent in the macrostate /i for all trajectories 
Cx with a; e A„ (apart from at set of measure zero) is 

J^in) = m(M n A«)/m(A«). (12) 

For such a system it is clear that temporal behaviour will be the same for all 
trajectories^® within a A^;. The division must be between those members of the 
ergodic decomposition in which the behaviour is thermodynamic-like and those 
in which it is not. So: 

Tl) We indicate that the system is behaving in A^ in a way which can be 
counted as thermodynamic-like by writing 

t«(m) ~ Ti^i), V (13) 

T2) We denote by A(^) the union of all A« satisfying (13) with A^*) = AXA^"^) 
and by the probability^^ that the system is in A^. Then thermodynamic- 
like behaviour is typical for the system if 

A^CA(A) 



^'^Quantification of what counts as thermodynamic-like and then what count as a tolerable 
degree of atypical non-thermodynamic-like behaviour could both be developed using the sort 
of £ criteria described above for e-equilibrium. 

Vranas (1998) has argued that many dynamic systems of interest are e-ergodic, but as yet 
the hard evidence for this is lacking. 

^"At all relevant places in the following discussion the phase: 'except possibly a set of 
measure zero', is taken to apply. 

■^"The meaning of which is discussed in Sec. 6. 
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5 The Gibbs Approach 



Given that we are concerned to incorporate both Boltzmannian and Gibbsian 
view of statistical mechanics into our overall picture, we must now examine the 
role to be ascribed to the Gibbs approach. This we do by means of a simple 
example. 

Consider a gas of N particles moving in d dimensions. Then the phase vector 
a; 6 r is 2(iiV-dimensional, composed of configuration and momentum vectors 
q(k) = (gW^ . . . ^ ^W) and pf'^) = ip[''\ . . . k = l,2,...,N. Let A corre- 

spond to the gas being confined to the hypercubic box B = {x\ — < < 
^L, V A;, Va}. Then, if it is left undisturbed 'a sufficient time to attain thermo- 
dynamic equilibrium', the phase-point x will, according to the Gibbs prescrip- 
tion, be distributed in A according to the appropriated equilibrium probability 
density function, which we denote by Pg{x). 

Now suppose that the gas is confined by a partition to the part of the box, 
denoted by B'^~\ with q[''^ < 0, Vfe. In this situation, if the system is left to 
attain thermodynamic equilibrium, the appropriate probability density function 
will be p'^r\x), which differs from Pg{x) only in respect of the restriction on the 
configuration space. If the partition is removed at time t = the probability 
density function is 

r pi-\x), xga^-\ 

p{x;0)=l (15) 
I 0, otherwise, 

where A^"^ is that part of A corresponding to all the particles being in S^"). This 
is no longer the equilibrium distribution; it will be the initial condition for a non- 
equilibrium solution p{x; t) evolving according to Liouville's equation. However, 
as we have indicated, the Gibbs entropy for this solution remains constant and 
p{x;t) does not converge to Pg{x) either in finite time, as we would like for 
thermodynamics, nor even on an infinite time scale. The most we can obtain 
is, for a mixing system, when the expectation values of a certain class of phase 
functions calculated using p(x; t) converge, as t — > cxd, to their expectation values 
calculated with Pg{x). The resolution to this problem suggested by Gibbs (1902, 
p. 148) (see also Ehrenfest and Ehrenfest-Afanassjewa, 1912) was to coarse- 
grain the phase-space; in the manner in which macrostates were obtained in the 
Boltzmann approach. In the macrostate fx the probability density function p{x) 
is replaced by n{p,) / ra(/x) where 

7T(/i) = / p(a;)dra, (16) 
is the probability of the phase point x being in /x. Then from (3) 

(5'G)cG[7t] = - k^Y^nin) ln[7t(/x)] +k^Yl "('^) l^M^)]- (17) 
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The objections to this approach are well-known^"'^ and we shall not discuss them 
here. We shall suggest a different approach. 

Suppose that a phase point xq G A'"). What is the probability of the 
system being in a small measurable set 5Ao around Xq7 This will clearly de- 
pend on the physical circumstances of the system and will differ according to 
whether the phase point is confined to A^"^ by the physical partition. In that 
case, if the system is in 'thermodynamic equilibrium' the probability will be 
PG~^(3^o)Tn.(6Ao). However, if the partition is not present and the system is in 
'thermodynamic equilibrium' the probability will be /9G(a^o)iTL(5Ao). Since xq 
corresponds to all the particles of the gas being in one end of the box, it will 
(in our Boltzmann language) be a rather 'uncommon state' and we expect that 
Pg(3^o)tti-(6Ao) ^ p'ir\xo)m{bAo). Now consider the case where at time t = 
the partition is removed. According to the Gibbs prescription, the probability of 
X £ 6Ao is p{xq; 0)m(6Ao) — pc ''(a;o)ta(6Ao). The removal of the partition has 
not affected the probability. But compare this situation with that where there 
has never been a partition present and the system phase point is in 6Ao. What 
physically distinguishes the two cases? If, in the course of its dynamic flow, the 
system is at a;o at t = 0, its forward evolution will not affected by whether a 
partition has just been removed or whether it simply happens to have evolved 
into this state. So why should a different probability distribution be assigned 
to these two situations when t > 07^^ A consistent approach, consonant with 
our treatment of the Boltzmann approach, is to suppose that the only mean- 
ingful probability density function to be used from the Gibbs approach is the 
time-independent solution of Liouville's equation determined by the dynamics 
and the physical constaints on the system. A change of physical constraints will 
lead to an instant discontinuous change in the probability density function and 
the Gibbs entropy. An uncommon state (like, for example, the case of all the 
particles being in one end of the box) will have low probability when calculated 
using Pg{x) and low Boltzmann entropy, but the same Gibbs entropy as any 
other configuration. 



6 Probability 

In the Gibbs approach of Sec. 5 we introduced the probability density function 
p{x) on the invariant set A and in terms of this, in (16), defined the probability 
7t(/i) that the phase point will be in the macrostate p. What we have not done 
is define what we mean by probability. Within the Gibbs approach this is most 
frequently done using ensembles, which means that the probability density is 
not the property of a single system. But we have already indicated, in Sec. 1, 
that our object of interest is a single system. Our aim in this work is to bring 
some kind of reconciliation between the Gibbs and Boltzmann approaches and, 

■^^Scc Riddcrbos (2002) for a recent discussion and Ridderbos and Redhead (1998) and Lavis 
(2004) for the apphcation of course-graining to the spin-echo system. 

■'^Of course, the trajectories for t < will differ and the system from which the partition 
was removed can be regarded as suffering from 'false memory syndrome'. 
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as asserted by Lebowitz (1993) (see the quotation in Sec. 1), this latter neither 
has nor needs ensembles. 

We need two probabihties, that the phase point is moving on a particular 
trajectory and that on that trajectory the phase point Hcs in a particular subset 
of A. For the latter we shall follow Von Plato (1989) in using the time-average 
definition of probability. This analysis is simplified if, as we shall do, the ergodic 
decomposition (11) is assumed. Then: 

(i) The probability = Prob(a; e A^) was introduced in Sec. 4.2. It can be 
taken to mean either the probability that when we choose the initial point 
x{0) it is in A^ or the probability that when we investigate the system we 
find the phase point in A^. In either case the probability is susceptible to 

a Bayesian or Laplacian interpretation. 

(ii) The conditional probability that x G iJ. given that £c G A^ is, from (12), 

Prob(x g f,\x g A.) = T.(m) = "^^^.^ "^"^ , (18) 

where the first equality represents the time-average definition of probabil- 
ity. 

Then 

Prob(a; g ;u) = ^ Prob(a; g ij,\x g A«) = (Prob(a; g ij\x g A«))ed, (19) 
{«} 

where (•)ed denotes the expection value over the ergodic decomposition. 

In each ergodic component there is a unique probability density function 
invariant under the flow given by 

r l/m(A«), X g A«, 
P.{x) = { (20) 
0, otherwise 

and 

P{x) = ^ Pf,{x) Pk = ((0,t(a;))ED- (21) 
{«} 

Then, from (16), (20) and (21), 

7r(M) = Prob(x g m) = E I rA ^ P- ^^2) 

as given by (18) and (19). 

For any functions /, integrable on A, and S , summable on the macrostates, 
the expectation value, of / with respect to p and S with respect to n, are 
respectively 

{f)p= [ p{x)f{x)dm, (g), = ^7r(;u)g(/x). (23) 
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Clearly 

(/)p = where = ^ f p(x)/(x)dm. (24) 

The time-average of S along a trajectory in is 

gM=^T«(M)S(/x) (25) 
and, from (18), (19) and (22), 

( SM ),o = E E n A.) S (M) = ( S (26) 

When the system behaviour in A^ is thermodynamic-like it follows, from (10) 
and (13), that 

sfc)^E^S(M). (27) 

A phase function / which happens to be constant over each of the macrostates 
H has f{x) = ifllJ,), Vx e /Lt, giving {f)p = (/)„. In particular, from (22), 

(5b)p = {SbU = fee E zSt-) E ^(/^ n HMl^)]- (28) 

Relating the Gibbs entropy to the Boltzmann entropy will necessitate some 
rational choice for the probabilities {Pk}. One view of is that it is the 
probability that, if wo make a random choice for the the initial system point 
a;(0), then it lies in A^. If we assume that all points of A are equally likely then 
on Bayesian/Laplacean grounds and consonant with the approach of Bricmont 
(2001) we should choose 

p« = m(A«)/m(A). (29) 

Then, from (20), (21) and (22) 

p{x) = l/m(A), 7T(/i) = m(/i)/m(A), (30) 

which is the microcanonical distribution. From (3) and (6), 

So = Sa = fee ln[m(A)] (31) 
and, from (28), 

{Sn)p = {Sn)n = 5g + fee E ^('") InK/x)]. (32) 
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When the system behaviour in is thermodynamic-like, it follows, from (26) 
and (27), that 



7 Proposals 

In this section we shall make the following assumptions: 

(a) That the system has the crgodic decomposition (11)."^^ 

(b) That the probabilities {p^} for the system phase point being in members of 
the decomposition are given by (29). 

(c) That (34) applies and thus that thermodynamic-like behaviour is typical. 

Assumption (a) is a purely dynamic assumption which may or may not be true 
for any particular system. The statistical assumption (b) is again based on the 
dynamics and has the same status as the assumption one might make about a die 
being unbiased when making a sequence of trials. Assumption (c) has a dynamic 
aspect but is also dependent on some quantification of whether behaviour is or 
is not thermodynamic-like. 

As indicated in Sec. 1, two of the obstacles to overcome, in reconciling the 
Boltzmann and Gibbs approaches, are the different definitions of equilibrium 
and of entropy. With regard to equilibrium we propose, as indicated in Sec. 4.1, 
that the two- valued condition of the system being or not being in equilibrium is 
replaced by a continuous property called commonness, based on a designation 
of macrostates related to a set of macrovariables. A microstate is more or less 
common according to whether the macrostate in which it is situated is of greater 
or smaller size. The Boltzmann entropy is a measure of the size of macrostates 
and thus provides a measure of commonness. Gibbs methods with a time- 
independent probability density function are to be retained as the practical 
means for obtaining an 'analogue' of thermodynamics. The reason for using 
a time-independent probability density function to calculate thermodynamic 
properties is not that the system is in equilibrium but that the underlying 
dynamic is autonomous. 

The question of entropy can be subsumed into a more general account of the 
relationship between statistical mechanical and thermodynamic variables. As 

Of course, the analysis includes the ergodic case where the decomposition has one member 
with pi = 1. 

^''A non-autonomous dynamic system would not yield a time-independent solution to Liou- 
ville's equation. 
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and, 




(33) 




(34) 
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we have indicated in Sec. 3, the standard Gibbs perception of the relationship 
between statistical mechanical and thermodynamic variables is that they fall 
into three classes. Those for which 

CI) the corresponding statistical mechanical variable is related to a phase func- 



C2) the statistical mechanical variable and thermodynamic variable are identi- 
cal and equal to an external parameter of the system. 

C3) the corresponding statistical mechanical variable is a functional of the prob- 
ability density function. 

The primary example of C3 is the entropy given by the Gibbs formula (3).^^ 
In the interests of producing a smooth relationship between the Boltzmann and 
Gibbs approaches we shall make two modifications to the CI C3 scheme. The 
first, which is part of the standard Boltzmann approach, is to related thermo- 
dynamic entropy to a phase function (which is also a macrovariable) , namely 
the Boltzmann entropy Sb{x); so entropy is now of type CI. The second is to 
propose a particular relationship, in the case of CI variables, between thermo- 
dynamic variables and phase functions. 

In Sec. 3 we introduced the set S of macrovariables defined on the macrostates 
{fj.}. The scheme we now propose is that a thermodynamic variable, F in class 
CI, is related to a phase function f{x), defined on A, via a macroscopic function 
G S. The statistical mechanical variable is the macrovariable J' . In the 
case of entropy the phase function and macrovariable are identical and equal 
to the Boltzmann entropy. For other thermodynamic quantities this is not the 
case. We are, thus, proposing the three-part scheme / 3^ f , where we 
need to explicate the relationships denoted by 

3^ F : The value is the result of a measurement of /, course-grained, 

to effectively give the same value throughout the macrostate fi. This perception 
together with the definition of macrostates and the Boltzmann entropy in Sec. 3 
serves as the demarcation between the microscopic and macroscopic realms. Of 
course, this demarcation is to some extent arbitrary, but it is equally so for any 
macroscopic physical theory.^^ The value of the thermodynamic quantity F, 
along the trajectory C^.^ passing through a^o, we take to be equal to the average 
of the result of a large number of measurements of 5" taken at arbitrarily chosen 
times. So we can effectively define 



^^The class into which a variable falls depends, of course, on the environmental conditions 
of the system. Thus for a thermally open system the temperature is an independent param- 
eter, whereas for a thermally closed system (like the isolated systems considered here) the 
temperature is a functional of p. 

^®See e.g. the definition of fluid density in Landau and Lifshitz (1959, p. 1). 



tion. 




(35) 
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is a constant of motion, but not constant on A except when the system is 
ergodic. When A has the ergodic decomposition (11), F has the set of values 



F, = ^T,(/x)J(m)= 3^ in). 



(36) 



Prom (33), when the behaviour in A^ is thermodynamic- Hke, 



(37) 



Mcasiu-emcnt of the thermodynamic variable F will typically lead to a value 

close to {J')tz- 

f J : We now need to be more precise about what we mean by the macrovari- 
able 3" . Ideally, of course, the identification 



in the notation of (24), would be desirable, because then it follows from (37), 
that, for thermodynamic-like behaviour, 



This, to within the tolerance indicated by is the standard identification be- 
tween thermodynamic variables and the expectation values of phase functions 
in Gibbs theory. As we have observed in Sec. 6, (38) is exactly true for the 
Boltzmann entropy because it is, by definition, constant over each macrostate. 
Wo shoiild not expect this to be true for all phase functions. But, of course, 
not all phase functions have a correspondence with thermodynamic variables. 
In particular we shall assume^'' f{x) is (a) continuous on each macrostate and 
(b) invariant under permutations of the N microsystems. We have already 
assumed, in Sec. 3 condition (iii), that each macrostate is invariant under per- 
mutations of the N microsystems. So the macrostate can be divided into 
non-overlapping subsets A//, j = 1, 2, . . . , each of identical m-measure. 
Representing by a generic member of this set, it follows, from (24), that 



When macrostates are constructed from cells in the one-microsystem phase 
space, rifj, is the combinatorial factor in (4) and Ta(A^) ~ m(A)/p". This 
latter becomes small as p becomes large. In this case, since f{x) is continuous 

These are two of the properties assumed for a finite-range observable function by Lanford 
(1973, p. 2-3), but, as he says, his use of the word 'observable' is not intended to have "any 
profound significance" . 



3^(m) = (/Im), 



(38) 



^ {f)p- 



(39) 




(40) 
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over A(/i), it is likely to vary very little.^* Although the macrostate /i may 
be a very large part of A it will be made of a large number of cells in each of 
which f{x) has the same nearly constant value. Thus^® 

^■(/x) ~ /(cc), for any point cc € /X (41) 

and 

{3^)n ~ {f)p, as the size Ta(A^) becomes small for all /U. (42) 

So to recapitulate the steps of the argument: 

(i) Thermodynamic variables are time-averages of phase functions / course- 
grained (to produces statistical mechanical variables) over macrostates. 

(ii) The thermodynamic variable is approximated along (typical) thermodynamic- 
like trajectories by the average of / with respect to the probability density 
function p. 

This establishes the relationship between a Boltzmannian view of thermody- 
namic variables as time averages and the Gibbsian view in which they are phase 
averages with respect to the appropriate probability density function. 

We now consider in more detail the case of entropy. It is often said that in 
"equilibrium [the Gibbs entropy] agrees with Boltzmann and Clausius entropies 
(up to terms that are negligible when the number of particles is large) and 
everything is fine" (Bricmont, 1995, p. 188). Apart from the caveats we have 
entered in Sec. 4.1 with respect to the concept of equilibrium, this assertion is 
based on two propositions (i) that the appropriate probabihty density function 
for the Gibbs approach is given by the microcanonical distribution (30) and (ii) 
that for large N the 'equilibrium' macrostate effectively fills the whole of A. 
The first of these we have established, within our approach, for a system with 
an ergodic decomposition and with the choice of probabilities (29). In the case 
where macrostates are defined using the cell method described in Sec. 4, (ii) is 
not difficult to establish. Using Stirling's formula with (8), 



Hv{N,p)] 



N 



^P-'^^m, ^ith fixed,. 



> as iV ^ 00. (43) 



N 

[ (l+01n(l+0-Cln(0, with p = ^N, J 
So in the case where p, the number of cells is fixed, it follows from (7) that 
iS^)u../N ^ So/N, (S^)r/N ^So/N, as AT ^ oo. (44) 

**One might at this stage, augment the conditions on /, given above, to the full set defining a 
finite-range observable (Lanford, ibid). Then, for large N, the results of Lanford and Khinchin 
(1949, p. 62—69) could be used to assert that the dispersion of / around {f)p is small. 

^^The symbol used here to indicated approximate equality, should be distinguished from 
'~' which is used in this paper with the special sense of 'approximately equal in a system for 
which thermodynamic-like behaviour is typical'. 
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Figure 6: The scaled Boltzmann entropy for the perfect gas model with = 
1000, p = 100. The gas is allowed to evolved in the time interval < t < 50 
confined to the left half of the box and then in the interval 50 < t < 100 into 
the whole box. The upper and lower horizontal lines in each range correspond 
to Sg and (5*3 ) Max respectively. 

This is in agreement with the results shown in the diagonal figures in Fig. 4 
where we see that the value at which the entropy settles down is closer to the 
maximum entropy for larger values of N. In the second case 1/^ is the number 
of microsystems per cell. With both N and p large the convergence is effected 
by increasing the number of microsystems per cell ^ 0). This is illustrated 
by the figures in the vertical columns of Fig. 4. It also follows from (33), (32) 
and (7) that 



As an illustration of these results we take the perfect gas and suppose that it 
is first confined by a partition to the region a; < 0. The Gibbs entropy, given 
by (6) and (31), is S^"^ = k^Nln{L/2) and = k^NlniL), for the respective 
cases where the gas is confined by the partition and where it is free to evolve 
over the whole box. The Boltzmann entropy in the latter case is given by (2) 
and (4), with V = L and in the former case by the same formula but restricted 
by the condition that A''^ = for ^ > p/2.^^ We consider the situation in which 
the system starts in a minimum entropy macrostate (with all the particles in 
the first strip). It is allowed to evolve over the time interval [0, 50] in the region 
a; < 0. The partition is then removed and it is allowed to evolve in the whole box 
in the time interval [50,100]. This is shown in Fig. 6 where {Sq — {SB)^^,,^) / {Nks) 
in each range is well within the upper bound given by (7) and (43). 

^''This expression is, of course, exactly the same as that for a box of length L/2 partitioned 
into p/2 strips. 
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8 Conclusions 



In this programme we have used ergodicity and ergodic decomposition and as 
indicated in Sec. 1 there is deep (and justified) snspicion of the use of ergodic ar- 
guments to support the foundations of statistical mechanics, particularly among 
philosophers of physics. Having given a comprehensive review of the problems 
of ergodic arguments, Earman and Redei (1996, p. 75) offer the opinion "that 
ergodic theory in its traditional form is unlikely to play more than a cameo 
role in whatever the final explanation of the suc;cess of equilibrium statistical 
mechanics turns out to be" . In its 'traditional form' the ergodic argument goes 
something like this: (a) Measurement processes on thermodynamic systems take 
a long time compared to the time for microscopic processes in the system and 
thus can be effectively regarded as infinite time averages, (b) In an ergodic 
system the infinite time average can be shown, for all but a set of measure zero, 
to be equal to the macrostate average with respect to an invariant normalized 
measure which is unique. The traditional objections to this argument are also 
well known: (i) Measurements may be regarded as time averages, but they are 
not infinite time averages. (If they were one could not, by measurement, inves- 
tigate a system not in equilibrium. In fact, traditional ergodic theory does not 
distinguish between systems in equilibrium and not in equilibrium.) (ii) Ergodic 
results are all to within sets of measure zero and one cannot equate such sets 
with events with zero probability of occurrence, (iii) Rather few systems have 
been shown to be ergodic. So one must look for a reason for the success of 
equilibrium statistical mechanics for non-ergodic systems and when it is found 
it will make the ergodicity of ergodic systems irrelevant as well. 

Our use of ergodicity differs substantially from that described above and 
it thus escapes wholly or partly the strictures applied to it. In respect of the 
question of equilibrium/non-equilibrium we argue that the reason this does not 
arise in ergodic arguments is that equilibrium does not exist. The phase point 
of the system, in its passage along a trajectory, passes through common (high 
entropy) and uncommon (low entropy) macrostates and that is all. So, al- 
though in our definition of a thermodynamic variable we have extended a large 
finite number of measurements to an infinite set of measurements, we cannot 
be charged with 'blurring out' the period when the system was not in equilib- 
rium. The charge against ergodic arguments related to sets of measure zero 
is applicable only if one wants to argue that the procedure always works; that 
is that non-thermodynamic-like behaviour never occurs. But we have, in this 
respect taken a Boltzmann view. We need thermodynamic-like behaviour to be 
typical, but we admit the possibility of atypical behaviour occurring with small 
but not- vanishing probability.^^ While the class of systems admitting a finite or 
denumerable ergodic decomposition is likely to be much larger than that of the 

^^In the sense that it is the only invariant normalized measure absolutely continuous with 
respect to the Lebesque measure. 

*^For our model systems we have indicated in Sec. 4.2 the way in which atypical behaviour 
can occur and Lavis (2003) demonstrates simulations of cases of this kind. 
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purely crgodic systems, there remains the difficult question of determining 
the conditions under which the temporal behaviour along a trajectory, mea- 
sured in terms of visiting-times in macrostates, approximates, in most members 
of the ergodic decomposition, to something recognizable as thermodynamic-like 
behaviour. 
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